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Abstract 



We analyze properties of the firing map, which iterations give information about consec- 
utive spikes, for periodically driven linear integrate-and-fire models. By considering locally 
integrable (thus in general not continuous) input functions, we generalize some results of 

r^ ' other authors. In particular we prove theorems concerning continuous dependence of the 

firing map on the input in suitable function spaces. Using mathematical study of the dis- 
placement sequence of an orientation preserving circle homeomorphism, we provide also a 

1 -^ , complete description of the regularity properties of the sequence of interspike-intervals and 

C^ ' behaviour of the interspike-interval distribution. Our results allow to explain some facts con- 

cerning this distribution observed numerically by other authors. These theoretical findings 
are illustrated by carefully chosen computational examples. 
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■<st ! 1 Introduction 

^^ The scope of this paper are one-dimensional integrate-and-fire (IF) models 

X = F{t,x), F-.m^^R (1) 

/\^ '. lim x{t) = Xr if x{s) = xt, (2) 



The dynamical variable x{t) evolves according to the differential equation (1) as long as it reaches 
the threshold- value x = xt, say at some time ti. Next it is immediately reset to a resting value 
X = Xr and the system continues again from the new initial condition {xr,ti) until possibly 
next time ^2 when the threshold is reached again, etc.. Hybrid systems of this kind are present 
in neuroscience, where this threshold-reset behaviour is supposed to mimic spiking (generation 
of action potential) in real neurons. Of course, x^ and xt could be arbitrary constant values 
and, moreover, it is possible to consider varying (i.e. time-dependant) threshold and reset, 
which allows to introduce to the one-dimensional spiking models some other more biologically 
realistic phenomena (such as refractory periods and threshold modulation [Gedeon, Holzer 2004]). 
However, often analysis of models with varying threshold and the reset can be reduced through 
the appropriate change of variables to studying the case of constant Xr and x-p (see e.g. [Brette 
2004]). 
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Except for the models of neuron's activity IF systems (and circle mappings induced by them 
in case of periodic forcing) can also be used in modeling of cardiac rhythms and arrhythmias 
([Arnol'd 1991]), in some engineering applications (e.g. electrical circuits of certain type, see 
[Carrillo, Hoppensteadt 2010]) or as models of many other phenomena, which involve accumula- 
tion and discharge processes that occur on significantly different time scales. 

For simplicity set x^ = and x^ = 1 and suppose that the equation (1) has the property of 
existence and uniqueness of the solution for every initial condition (to,a^o) £ ^'^■ 

Definition 1.1 The firing map for the system (l)-('2) is defined as 

$(i) := inf{s > t : x{s; t, 0) > 1}, t G M, 

where Xr = 0, xt = 1, and x{-;t,0) denotes the solution of (1) satisfying the initial condition 
(t,0). 

Of course, the firing map <^(t) does not need to be well defined for every t G R since for some 
t it might happen that the solution x(-;t,0) never reaches the value x = 1. Thus the natural 
domain of <1> is the set (compare with [Carrillo, Ongay 2001]): 

D$ = {t G M : there exists s > t such that x{s; t, 0) = 1}. 

Later on we will give necessary and sufficient conditions for the firing map <l> : M — t- M of the 
models considered to be well-defined. 

The consecutive firing times t„ can be recovered via the iterations of the firing map: 
tn = ^"(to) = Htn-i) = inf{5 > cl>"-Hto) : x{s; «l>"-Hto), 0) = 1}, 



and the sequence of interspike-intervals (time intervals between the consecutive resets) is given 
as 



tn-in-l = 'J>"(to)-$"-'(t0 



There are two basic quantities associated with the integrate-and-fire systems, the firing rate: 

FR(to) = lim — = lim 



n-5>oo tn n~^oo <I)"(to) ' 

and its multiplicative inverse, which is the average interspike-interval: 

alSI(to) = lim ^ = lim ^^. 

n— >oo n n— >oo n 

Obviously, in general the limits above might not exist or depend on the initial condition 
(to,0). 

In [Keener, Hoppensteadt, Rinzel 1981] the following observation for periodically driven mod- 
els was made (the remark was not directly formulated in this way but it is a well-know fact): 

Fact 1.2 // the function F in (1) is periodic in t (that is, there exists T such that F{t,x) = 
F{t + T, x) for all x and t), then the firing map $ has periodic displacement ^ — Id. In particular 
for T = 1 we have <I>(t -|- 1) = <&(t) -|- 1 and thus ^ is a lift of a degree one circle map under the 
standard projection p : 1 1— ?• exp{2mt). 

In case of periodic forcing, the underlying circle map c^ : 5*^ — )■ 5"^ such that $ is a lift of 99, is 
referred as to the firing phase map. 

Mathematical analysis of one-dimensional IF models was performed e.g. in [Brette 2004, Car- 
rillo, Ongay 2001, Gedeon, Holzer 2004]. Firing map was also investigated combining analytical 
and numerical approach ([Coombes, Bressloff 1999] - phase-locking and Arnold tongues, [Keener, 
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Hoppensteadt, Rinzel 1981] - LIF model with sinusoidal input, [Ono, Suzuki, Aihara 2003] - LIF 
with periodic input, [Tiesinga 2002] -LIF with periodic input and noise, ...). Analytical results 
concerning the firing map ^ were obtained assuming that F{t, x) is regular enough (always at 
least continuous) and often periodic in t. 

In particular, we will take into account the Leaky Integrate-and-Fire model (LIF): 

± = -ax + f{t) (3) 

and the Perfect Integrator (PI): 

i = f{t), (4) 

where / : M — )• M will be, usually, periodic and not necessary continuous but only locally- 
integrable. Allowing also not continuous functions might be important from the point of view 
of applications where the inputs are often not continuous. Moreover, although as for the firing 
map of systems with continuous and periodic drive some rigorous results have been proved (e.g. 
in [Brette 2004, Carrillo, Ongay 2001, Gedeon, Holzer 2004]), the sequence of interspike-intevals 
even in such a case, according to our knowledge, has not been investigated in details yet. How- 
ever, sometimes the sequence of interspike-intevals might be of greater importance than the exact 
spiking times themselves ([Reich et al.\). Interspike-intervals are said to be used in information 
encoding by neurons (see [George, Sommer 2005] and references therein). Here we will give a de- 
tailed description of the sequence of interspike-intervals and interspike-interval distribution with 
the use of mathematical result concerning displacement sequence of an orientation preserving 
circle homeomorphism proved by us in submitted papers "On the regularity of the displacement 
sequence of an orientation preserving circle homeomorphism" and "Distribution of the displace- 
ment sequence of an orientation preserving circle homeomorphism". However, full exposition of 
these theorems and proofs in available also in [Marzantowicz, Signerska 2012]. 

2 Locally integrable input functions for LIF and PI models: some 
general properties 

2.1 Preliminary definitions and facts 

Unless stated otherwise, considering the LIF-model (3) we assume that o" > 0, admitting also 
o" = to include Perfect Integrator (4) as well. As for the function / in (3) and (4), we assume 
that / G Lj'q^(M), i.e. for every compact set yl C M the Lebesque integral J^ \f{u)\ du exists and 
is finite. For such functions we redefine the notion of the firing map: 

Definition 2.1 For systems (3) and (4) the firing map <I> is defined as 

$(t) := inf{t* >t: (f^< [f{u) - a]e™ du}. (5) 

The above definition is generalization of the "classical" firing map ^ for the differential equation 
(3) with / continuous, since from Definition 1.1 <& has to satisfy the implicit equation: 

/■*(*) 
e"^* = / [/(u) - aY"" du. (6) 



Lemma 2.2 The necessary and sufficient condition for the firing map (5) $ : M — )■ M to 6e 
well-defined is that 

limsup / [/(n) - aje'"" du = oo (7) 

t-+oo JO 
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Proof. Suppose that (7) is satisfied. Choose to E M. Then liuisup^^^ J^ [/(^) ~ (7]e'^" du = oo 

and hence there exists i* such that J^*[f{u) — a]e'^^ du > e*^*". Consequently $(to) is defined. 

Now assume that $ : M — ?• M is defined, i.e. for every t G R there exists t* = $(i) such 
that e*^* = f^ [f{u) — (T]e'^'^ du. In particular, by Definition 2.1, taking t = we obtain that 

n = /o*"^°^[/(u) -cT]e'^" du. Thus lim„^oo ft [f (u) - (^]e'''' du = oo for t„ = $"(0), which proves 
the statement. □ 

Lemma 2.3 In the model (3) with o" > and f £ Lj^^{W), suppose that there exists ? > such 
f{t) — a > <, a.e. (i.e. for almost all t £ R in the sense of Lebesque measure). Then the firing 
map $ : M — 7- R is a homeomorphism. 

Proof. Notice that under the stated assumptions, D$ = R on the ground of Lemma 2.2 because 
for every fixed t the integral J^*[fiu) — cr]e'^'^ du is a strictly increasing unbounded continuous 
function of t*. It follows that <!> is also a continuous monotone function. From (5) we have 
< <l>(t) — t < 1/^ which gives that limt_j.oo *^(i) = oo and limt^_oo ^(i) = — oo and ends the 
proof. D 

We prove the following simple lemma: 

Lemma 2.4 Suppose that f G L[g^(R). Then every run of the model (3) has only finite number 
of firings in every bounded interval. 

Proof. Suppose that there is a firing at time to- Denote t.„ = #"(io) for n G N. If {i„} C [a, h] for 
some bounded interval [a, 6] C R (i.e. lim,„^oo ^n = i* G (o, 6] as sequence t„ is non-decreasing), 
then from equation (5) (or equivalently from the solution x(t;to)0) = ^~"^ Ji^ f{u)e"'^ du of (3) 
and the condition x{ti]tQ.,Q) = 1 for the firing at time ti) we obtain that 

e'^*! = / ' /(u)e'^" du < e^*i / ' |/(n)| du 



f' fiu)e-^du<e^'^ fulfil 

Jto Jto 



and thus 1 < /^ ^ 1/(^)1 f^^ ^-i^d in general 1 < J^ " 1/(^)1 du for n G N U {0}. From this we 
estimate that 

n < / |/(n)| du < / |/(n)| du. 

Jto J a 

As n is arbitrary, it results in J \f{u)\ du = oo, which contradicts that / G Lj'q^(R). D 

2.2 Special properties of the Perfect Integrator 

The simple model (4) has many distinct properties than other models. Here we list some of 
them (for the proofs we refer to [Marzantowicz, Signerska 2011]). 

Fact 2.5 Suppose that f G LJ^^iM.) and let <!• be the firing map for the Perfect Integrator (4)- 
Then: 

1. The consecutive iterates of the firing map are equal to 

$"(t) = min{s > t : x{s; t, 0) = n} (8) 

and there is only a finite number of firings in every bounded interval. 

2. <^ is increasing, correspondingly, non- decreasing, iff f{t) > 0, or f[t) > respectively, a.e. 

inR. 

3. If f{t) > a.e., then 

i) $ is left continuous. 
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ii) <l> is not right continuous at every point a £ <l>~^(a) for which there exists 60 > such 
that f{t) = almost everywhere in [a, a + 5q\. Furthermore, such points are the only 
points of discontinuity of^. 

4- If f{t) > a.e., then $ is continuous. 

For the simplified model (4) we even have the analytical expression for the firing rate. Indeed, 
the following theorem was proved in [Brette 2004] (originally for / continuous but the proof is 
vaHd for / G L/^^(M) as well): 

Theorem 2.6 Suppose that for the model (4) there exists a finite limit 

1 /■* 
r = lim - / f{u)du. (9) 

t^oo t Jq 

Then for every point to S K the firing rate r(to) exists and is given by the formula (9). In 
particular, the firing rate r{t) does not depend on t. 

The proof of the above theorem is immediate: It relies on the fact that n = f^ ^°' f{u) du 
for every to by definition of the firing map and if the above limit exists and equals r, then also 

lim„^oo $s^ 1*"^*°^ /(^) d^ = ^■ 

Example 1. Suppose that the function / in (4) is locally integrable, but is not continuous. 

Consider, for instance: 

2, t G [n,n+l/2], n G Z; 



■^^^' 1 0, tG (n + l/2,n + l). 

In this case we easily get that M{f) = 1 (and thus g = 1). By considering the solution x{t) of 
X = f{t) with the initial condition x{to) = 0, we obtain that 

r t+1, tG (A:, A: + 1/2), k £ Z; 

$(t) = } A; + 1/2, t = k; 

[ A; + 3/2, t G [A; + 1/2, A; + 1) 

In particular, $ is left-continuous, non-decreasing and constant in the intervals (A: + 1/2, A; + 1). 
However, it is not right-continuous at the points t = k. Note that at such points $(t) = k + 1/2 
and / = in the right neighbourhood (k + 1/2, A: + 1) of <I>(t) which agrees with Fact 2.5 (3.). 

2.3 Continuous dependence on the input function 

Definition 2.7 The essential supremum of the Lebesque measurable function 
/ : M — )■ M zs defined as 

ess supf := inf{a G M : A({t : /(t) > a}) = 0}, (10) 

where A denotes the Lebesque measure on M. //{a G M : A({t : /(t) > a}) = 0} = 0, then we 
write that ess supf = 00. 

// ess sup\f\ < 00, then we say that f is essentially bounded. 

We also define the essential supremum of f over a compact subset K cM. as 

ess supKf := inf{a G M : A({t G K : /(t) > a}) = 0}, 

In particular, for the measurable functions / and g, ess supj^^lf — g\ = a^, for some a* > implies 
that |/(t) — g{t)\ < a* a.e. in K. In general an essentially bounded function does not need 
to be measurable, since equivalently we might say that a^= is an essential supremum of / if the 
set {t : /(t) > a} is contained in some set of measure zero. However, we will consider only 
locally integrable functions, thus also measurable. Notice that when / is essentially bounded 
(and measurable), it is also locally integrable. However, a locally integrable function does not 
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need to be essentially bounded: take for example f{t) = —i= (with arbitrary finite value at 

V I* 



i = 0). 

We consider the space L[^^(M) of all locally bounded functions (i.e. / € Lj^^(R) iff ess supj^|/| < 
oo for every compact iT C M) as the Frechet space with semi-norms and metric defined respec- 
tively as 

ll/llL-([-fc,fc]) :=esssup[„fc^fc]|/| 

and 

oo ^ II /> II 

. / . x . V- 1 l|j-g|lL°°([-fc,fc]) 

dL- W,5) -Z^^T—TT—rr———- 

k=l ^^\\J 9\\L°°{[-k,k]) 

We will mainly consider measurable functions / G LJ^^(]R). Note that such functions form a 
subspace of Lj'q^(M), which is again a Frechet space with the following semi- norms: 

II/IIli([-M) •= / \f{'^)\du, A: = 1,2,3,... 

J[^k,k] 

The metric on L\^^l^) can be defined as 



oo 



'^L\Jf^9)--=Y.^\ 



1 \\f - 9\\L^{[-k,k]) 



k=l 



+ 11/ - 9\\L^([-k,k]) 



Lj'qj.(IR) with this metric is a complete metric space (see for instance [Maz'ya 1985] p. 2). 

Similarly in spaces C'^(M) and C^{M.) of, respectively, continuous and m-times continuously 
differentiable functions / : R — t- M, we introduce the metrics dcotm and dQ^nm-^ with the use of 
semi-norms: 

ll/llco([-fe,fc]) :=supjg[„fc^fc]|/(i)|, k= 1,2,3,... 

and 

ll/llc""([-fc,fc]) :=max{supjg[„^,^fc]|/(i)|,suptg[„fc^fc]|/(^)(t)|,...,suptg[_fc^fc]|/(™)(i)|}, k = 1,2,3,... 

where f^"''{t) is the n-th derivative of /. 

Proposition 2.8 In the model (3) with a > and measurable f S L^^(M), the mapping / i— )• $ 
is continuous from the L'^^(K) -topology into C^ (R) -topology at every point f satisfying f{t) — a > <; 
a.e. for some <f > 0. 

The above proposition says, in particular, that if we have a family of systems x = —ax -\- fuj{t), 
where c^; G ri C M'^ parameterizes {fui} continuously in the LJ^^(R)-topology and inf{c;"(a;) : 
fuj{t) — CT > ?(<^) a.e.} > 0, then the enough small change of parameter lo causes an arbitrary 
small change of the firing map $ in the C'^(M)-topology (but, of course, even if the firing maps 
<l>(^^(t) and (^i_j^{t) are uniformly close, the firing times t„ = <I?"j(to) and i„ = ^]^,^{tQ) with 
n — 7- oo might deviate a lot from each other). 
Proof of Proposition 2.8. Let f{t) — a > ? > a.e. Our aim is to prove 

Ve>0 35>o Vg:M^K ^L- {R)if,9) < 6 ^ dcO (^) {<^ f , ^ g) < e, (11) 



where $j and ^g are the firing maps induced by i = —ax-\-f{t) and x = —ax-\-g{t), respectively 
(/ and g satisfy requirements stated in Proposition 2.8). Firstly we prove that: 

Ve>o Va'sn 3jveN Js>o yg:R^R ess sup|/(i) - g{t)\ < 5 ^ sup |$/(i) -<i'g{t)\ < - (12) 

[-AT.iV] t£l-K.K] ^ 

Let then if G N be arbitrary. Define N := K -ir [-] , where [-] is the smallest integer greater or 

2 

equal 2/^. Let 6 := min{|, ^}. Choose the function g satisfying the assumptions and such that 
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ess sup[_jv,7v]|/(i) - g{t)\ < 5. Then g{u) -a > c^/2 > a.e. in [-iV,iV]. Let then t e [-K,K] 
be fixed and suppose that ^g{t) > ^/(t). By definition of the firing map, 

e^*= / [f{u)-a]e'''' du= / [^(u) - a]e^" du. 



It fohows that 



/ 



[^(^) _ ^]e-- dn = / [/(n) - 5(tx)]e-" du. 

l<S>f{t) Jt 

Since < $/(t) — t < !/<; by the assumption on / and t,t + !/<;" E [— -^, -^] by our choice of A'^, 
we estimate 



/ [giu) - a]e"" dn = / [/(n) - 5(n)]e"" du < 5($/(t) - t)e"*-'(*) < -e"*/(*) 



.fit) 
Simultaneously 



'•'S'sit) 



/ [g{u) - ar^ du > ||$,(t) - ^^Wle'^^/W, 

provided that <I>g(t) < N. However, suppose that ^g{t) > N. Then J^[g{u) - (T]e°"" du < e"'* 
by definition of the firing map. On the other hand, by our assumptions on N and g, 

J [g{u) - ale-^" du > '-{N - t)e'^' > '--e'^' = e"' 

and we arrive at a contradiction. Thus always ^g{t) < N and finally we obtain 

, ^ / X , / M 2 5 e 

|$3(t)-cl.^(t)|<--<- 

If $/(t) > ^g(t), then immediately ^g{t) < A^ (since <!>/(*) < iV as $/(t) - 1 < 1/?) and we can 
perform similar calculations. 

Now we show how (12) implies (11). Given e > 0, there exists the smallest integer K^ such 
that Ylk^K* W — ^/^ ^^^^ ^'^^^ 

^2^^2M+||cI>;(t)-$,(t)|bo([_,,,])<2 

Therefore if also J2k=i w i+\\if(t)-lg(t)fjo~!'_^''Jl, < I' *^^^ '^C0(R)(/,5') < e (the metric in the 
Frechet space). But us the function u i— )• j^ is increasing (from [0,oo) onto [0,1)) and the 
norms ||<I>j(t) — ^g{t)\\ca{\~k.k]) ^^^ non-decreasing with k, then 

^1 \\'^f{t)-%it)\\cOi[.k,k]) ^Y^l \\'^fit)-'^M\cO{l-K.,K,]) ^ 

f^2Ml + ll$f(i)-^„(t)llr-o,r_w-n) -^2Ml " ' ' ' ' ' ' " 



- 2*^ (1 + ||$/(i) - 1>g{t)\\cOii-k,k])) " frt 2^= (1 + ll^/(t) - $,(t)lbo([-K.,if.])) 



Now from (12) we know that there exists N^: = K^, + [-] and 5 such that ||/ — 5'||L°o(f_Af,,Ar,i) < 5 
implies ||<I*/(i) — *^g(i)||co([-i^*,x,]) < s/2 and thus it also implies dco(^-^{f,g) < e. But then 

II . ^11 . 1 \\f - g\\L--{[-N.,N-A) ^ 1 ^ 

\\j ~ g\\L?° (R) < TTATTm — n ^ oTv r 

led ^ 2^* l + ||/-5|U^([_;v.,7V.]) 2^*1 + 5 

Therefore with J := 2^7-^ we have dj;^oo (]r)(/, 5) < (5 ^=^ d(;;o imi'^f^^g) < ^) which proves 
the statement. □ 

Under stronger assumptions on / we prove the following: 
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Proposition 2.9 If f £ C^{M.), then the mapping / i— )• $ is continuous from the topology C^ 
into C^ (M.) -topology at every point f such that there exist ? > and M with c; < f{t) — a < M 
for all t. 

Proof. The equation (6), equivalent to e"^ = H{<^{t),t) witli H{x,t) = jf[fiu) - cr]e'^" du, 
differentiated with respect to t yields that 

Note that this formula is well-defined for all t since by our assumption /(<&(t)) — a ^ 0. 

Suppose now that ||/ — g\\L'^([-Nt,NJ) < ^ (notation as in the previous proof). Then for 
t G [—K^,Kif] we have the following estimates: $/(t) — t < 1/? and e~'^i^fW~^) < M/c;, corre- 
spondingly $g(t) — t < 2/? and e"'^*^*^*^*''"*) < 4M/?, which can be obtained from (6). Thus 

\$'f(t)^$' (t)\ = I ^ e-"'*^(*)-*) ^ e— (*sW-t)| < 

< | (/(t)-gW)(g(<&.(t))-a)e-^^'/W-') 

I (/(*/(*)) -a)(5($,(i))- a) 1^ 

MS g(t)[|e-(^/W-')(g($,(t)) - /($f (t)))| + !(/(% (t)) - a)(e-t^'/(')-*) - e-'^^t')-*)) 

As 5 — >• also |^/(t) — ^g{t)\ — )• uniformly in i E [— i^*,i^*] by the previous result. This 
proves the continuity of / i— )■ <I> from the Frechet space C^ (M) to the Frechet space C^ (M) . □ 

Remark 2.10 For the Perfect Integrator (4) we obtain that 

q>'(t) = _M^ (14) 

and thus in the same way (easier) we can prove the statement of Proposition 2. 9 for Pl-model 
under the assumption that f E (^''(M) and < ? < /(i) < Af . 

Lemma 2.11 For the model x = —ox + /(t), cr > 

a) iffe C''{R), where k E NU {0}, and f{t) - a > for all t, then $ E C''+i(IR), 

h) if f e ^LcW «^^ /(O - c^ > a.e., then $ E C°(IR). 

Proof. The first part is a direct consequence of the formula (13). The second one follows from 
the properties of the integral of a locally integrable almost everywhere positive function. □ 

3 Periodic drive for LIF and PI models 

Definition 3.1 We say that a function f E Lj^^(M) is periodic, if there exists T such that 
f{t + T) = f{t) a.e. 

Remark 3.2 Notice that if f £ C'^(M) is periodic, then the condition f{t) — a > (, for some 
c: > reduces to f{t) — a > 0. In this case $ : M — > M is a lift of an orientation preserving circle 
homeomorphism by the Fact 1.2. 

However, for locally integrable periodic functions the requirement f{t) — a > <; > a.e. is 
not equivalent to f{t) — a > a.e.: Take, for example, a = 1 and /(t) = 1/n + 1 for t E 
[k — „„_! , k — 2??), A: E Z, n E N. Nevertheless, for / E Lj'^^(]R) periodic it is enough to assume 
that /(t) — (T > a.e. in order to assure that the firing map $ (in the generalized sense of 
Definition 2.1) has the desired property: 
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Lemma 3.3 If f & Ljg^(M) is periodic with period T = 1 and f{t) — a > a.e., then the firing 
map $ induced by (3) is a lift of an orientation preserving circle homeomorphism. 

Proof. From (6) and periodicity of / we have 

f*(t+l) /■*(*+!) /■<I>(i+l)-l 



6^^^*+^) = / [/(n) - dje'^" du= [f{u - 1) - a]e'^" du = e'' [f{u) - a]e'^" du 

Jt+i Jt+i Jt 

which is equivalent to 

/ [/(n) - fj]e'^" du= [f{u) - aje""" du. 

Jt Jt 



Since for fixed t, F(t^,) = J^*[f(u) — a]e^'^ du is a continuous increasing function of i* as the 
integrand is positive a.e., the above implies that <&(t + 1) = $(i) + 1 and thus $ has the property 
of a degree one circle map. Then as $ is continuous and increasing, it must be in fact a lift of 
an orientation preserving circle homeomorphism. D 

Thus when / € Lj'q^(M) is periodic and f{t) — a > a.e., the unique firing rate FR(t) = r 
always exists (independently oft), since it is the reciprocal of the unique rotation number q{^) = 

lim„_,oo^,tGK. 

For the simple model (4), where / G Lj'j^^(IR), f{t) > a.e. and / is periodic (with period 1), 

<I> : M — )■ M is a lift of an orientation preserving circle homeomorphism ip (which is then the firing 

phase map), as follows from the lemma above. Moreover, in [Brette 2004] it was proven that in 

this case ip : S^ ^ S^ is always conjugated with the rotation rg by g via the homeomorphism 7 

with a lift r given as 

, . fn f(u) du , , 

r(t) := J0_i^L2 , t G M (15) 

/o fiu) du 

Formula (9) for the firing rate when / is periodic with period T = 1 reduces to r = L fiu) du. 
Thus 

g = — (16) 

/o fiu) du 

is the analytical expression for the rotation number of tp. One might check by a short direct 
calculation that indeed we have r($(t)) = Tit) + g, where T is continuous, increasing and satisfies 
r(t + 1) = r(t) + 1, i.e. 7 conjugates ip with r^. 

Observe that an almost everywhere non- negative function / : M — )• M, where / E -Lj'q^(M), 
defines a measure fif on M for which / is the density (the Radon-Nikodym derivative of ///), i.e. 



f,fiA) := / fiu)du (17) 

Ja 

where A is any measurable (Borel) subset of M. We have the following result: 

Proposition 3.4 Let f G LJ^^iW), fit) > a.e. be periodic, $ : M — )• M 6e the firing map 
associated with (4), and /ij the associated with f measure. 
Then /ij is ^-invariant, i.e. <^ preserves the measure fif. 

Proof. We have to prove that fj,fi^~^iA)) = /U/(yl) for every measurable set ^ C M. Since 

fJ-fiA) = inf ^ J ' fiu) du = inf ^xibi) — 2;(aj), where ^ is a cover of A by open intervals 

A i—i ' A {—I 

iai,bi), it is enough to show that //j($~^([a, 6])) = /ij([a,6]) for every interval [a,b] C M, with 
a < b. Moreover, since in this case <l> is a homeomorphism, it is equivalent to show that 
fifii^a), $(6)]) = fifia, b]. We have /.^([a, 6]) = /„' fiu) du and fifiMa), ^b)]) = /^^^'^ fiu) du. 
By the definition of the firing map, 
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b /■<I>(fe) 

f{u)du = / fiu)du, 

J$(a) 

which proves the Proposition. D 

Throughout the rest of this section we assume that 

1) / is measurable and / G LJ^^(]R) (thus in particular / G LJq^(M)) 

2) / is periodic (allowing also the case of / constant) in the sense of Definition 3.1 (with period 
T = 1, without the loss of generality) 

3) f{t) - a > a.e. in M. 

Under these assumptions the firing map <l> is a lift of a circle homeomorphism y? ~ $ mod 1. 
Note that in this case ^ satisfies <l>(t + 1) = #(t) + 1 for every t G M and thus the compact 
convergence in the Frechet space C'^(M) (C™'(]R)) is equivalent to the uniform convergence (uni- 
form convergence up to m-th derivative) on M because it is enough to consider $ and <!>„ cut 
to the interval [0, 1] (we say that $„ converges compactly to <^ if for every i^ C M compact 
lim„_>.oo sup^g/^ l^nit) — ^{t)\ = 0). In other words, if we admit only 1-periodic inputs / and /„, 
then suptgK |$„(t) - ^{t)\ supjgp^i] \^n(t) - $(i)| < e whenever iiijj^(iR)(/„, f) < 5 for sufficiently 
small 6. 

Except for the continuity of the mapping / i— )• <^ from the Lj^^(M)-topology into C''(M), we 
will also need the continuity / i— )• F, where F : M — )■ M is the lift of the map 7 : S^ — )■ 5^ (semi- 
)conjugating the firing phase map (f : S^ ^ S^ with the rotation r^, where g = Q{ip) G M \ Q is 
the rotation number of if. 

Lemma 3.5 Suppose that q{^) G M \ Q, where ^ is a firing map induced by the equation (3) 
with (T > 0. Then the mapping f >-^T, where F : M — t- M is a lift of 'j (semi-) conjugating ip with 
the rotation r^, is continuous from the L'^^iM) -topology into (7*^(M) (with supj^j at every point f 
such that f{t) — a > (, a.e. for some <;" > 0. 

By the continuity of / 1— )• F we mean that when / is a small enough perturbation of /, with 
respect to LJ^^-topology, and 'g = £>($) G M \ Q, then F can be chosen such that F and F are 
uniformly close, where $ is a firing map induced by x = —ax + f{t) and F is a lift of 7 where 
7 o ^ = r^ o 7. 

Proof. We have already proved the continuity of the mapping 99 i—)- 7 from C^{S^) — )■ C^{S^) in 
Theorem 3.2 in [Marzantowicz, Signerska 2012]. From this follows the continuity of $ — )• F from 
C'^(M) into C''(R) (with supj^-topologies) . Since we also have the continuity of / — >■ $ under the 
stated assumptions, the statement of the above lemma holds. D 

3.1 Regularity properties of the ISI„ sequence 

We will formulate some detailed results concerning regularity of the sequence of interspike- 
intervals for PI and LIF models. By regularity properties we mean periodicity, asymptotic 
periodicity and the property of almost strong recurrence. 

Due to Lemma 3.3 investigation of interspike-intervals ISI„(to) for / periodic is covered by the 
analysis of the displacement sequence rjn{zo) of an orientation preserving circle homeomorphism, 
being the firing phase map ip. Thus ISI„(to) equals ryn(zo) (where zq = e^'^**") up to some constant 
integer and the sequences ISI,i(to) and r]n{zQ) have virtually the same properties. 

Proposition 3.6 Consider the Perfect Integrator model x = f{t). IfT = L f{u) du = q/p G Q, 
then the sequence ISIn{t) for every initial condition (t, 0) is periodic with period q. 

ProoL The analytical expression for the firing rate (9) of PI model for / 1-periodic reduces to 
/n /("") du. This means that in our case the rotation number of the underlying firing phase map 
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(/9 : S^ — 7- S^ equals to g = 1/ L f{u) du. Thus if T = 1/ g = q/p is rational, 99 is topologically 
conjugated to the rational rotation Vg by g and thus there are only periodic orbits with period 
q. As a result, the sequence of displacements of y?, and consequently the sequence ISI„(io), is 
periodic with period q. □ 

Example 2. For the LIF model x = —x + , _ _g , where g E N, the sequence of interspike- 
intervals is constant: ISI.„(io) = Q- Indeed, in [Brette 2004] it was shown that the input current 
of such a form induces conjugacy with the rational rotation by g{^) = q. Consequently, the 
firing map $ satisfies $(i) = t -\- q and is simply a translation by q. Thus for every n G N and t 
we have $"'(t) — $"~^(t) = q and we observe 1 spike per every q periods of forcing. 

R. Brette ([Brette 2004]) also proved that f{t) = i_^q is the only one input current which 
induces conjugacy with a rotation by g G N (for o" = 1). It is much harder to show what are all 
the input currents that induce conjugacy with g = q/p (p 7^ 1) but this assumption implies some 
constraints on f{t), which seem to be quite restrictive (for some values of p/q the conjugacy 
might not be possible at all, see discussion in [Brette 2004]). Thus we might conclude that in 
"majority of cases" the firing phase map arising from the LIF model, which has rational firing 
rate, is not conjugated to the corresponding rotation and: 

Remark 3.7 For the LIF model with a firing rate FR = q/p, the sequence of interspike-intervals 
ISIn{to) is "typically" not periodic but only asymptotically periodic (with the period equal to q in 
the limit n — ?• 00 J. Precisely, 

^e>0 ^NeN V„gN VfcgN \ISInj^kq{to) — ISIn{to)\ < £ 

Proof. This is a direct consequence of Proposition 2.5 in [Marzantowicz, Signerska 2012]. D 
When the input function is periodic, the (asymptotically) periodic output of the system, in 
terms of interspike-intervals, is connected with the phenomena called phase-locking, see Figure 
1. Precisely, we say that the system exhibits q '■ p - phase locking (which corresponds to the 
rotation number equal to p/q), when it fires q spikes for every p cycles of forcing (the spikes 
occur in fixed phases of the forcing period) and this state is structurally stable, i.e. it persists 
under a small change of a parameter 9 € Q. Types of phase- locking change with the change of 
the rotation number, but the mapping ^ 1— t- ^ is usually constant (under some conditions) on 
rational values of g (look for such concepts as the devil-staircase and Arnold-tongues). 



Figure 1: An example of 4 : 3-phase locking 



In next we pass to the case of irrational firing rate. The same property as for the displace- 
ment sequence of a circle homeomorphism with the irrational rotation number can be shown for 
the sequence of interspike-intervals for the LIF model (see Proposition 3.20 in [Marzantowicz, 
Signerska 2012]): 

Theorem 3.8 Consider the LIF model x = —ax + f{t) (a > 0) where f G Ljg^{W) is periodic, 
f{t) — cj > a.e. and the rotation number g{^) is irrational. 

Then the sequence {/^/^(to)} is almost strongly recurrent for all to G A, where A is a lift to 
M of the underlying minimal set A C S^ (possibly A = S^), i. e. 

Ve>0 ^NeN Vn.gAf V^gNUJO} ^ie{0,l,...,N} llSIn+k+iito) — ISIn{to)\ < £ 

Moreover, if f & C'^{M.), then the sequence {ISIn{to)} is almost strongly recurrent for all to ^ M. 
(in this case A = S^). 
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Proof. Under the stated assumptions 99 : S^ — >• 5"^ is a homeomorphism with irrational rotation 
number. For to € A the underlying displacement sequence r]n{zo) = <&"(io) ~ ^""^(io) niod 1, 
zq = e^'^**", is almost strongly recurrent by Proposition 3.20 in [Marzantowicz, Signerska 2012]. 
But then the sequence of interest ISI„(to) = ^"'{Iq) — ^^~^{to) is almost strongly recurrent as 
well. 

As for the second part of the statement, notice that if / E C^(M) , then 93 G C'^{S^) and thus 
on the ground of the Denjoy Theorem ([Denjoy 1932]), ip is transitive and {ISI„(to)} is almost 
strongly recurrent for all tg £ I^- ^ 



Remark 3.9 Notice that Proposition 3.6, Remark 3.7 and Theorem 3.8 remain true when one 
replaces the "sequence of interspike-intervals" simply with the "sequence of firing times phases", 
i.e. the sequence <^"(to) mod 1. 

3.2 Distribution of interspike-intervals 

In this part we consider IF models, for which the firing rate, and consequently the rotation 
number of the firing phase map ip, is irrational. 

Proposition 3.10 Consider the LIF model x = —ax + f{t), where f £ Lj^^(K) is 1-periodic, 
f{t) —a > a.e. and the rotation number q = q{^) is irrational. By T denote the lift of j 
(semi-) conjugating (p with r^. Under these assumptions 

1) If Lf is transitive (for example when f G C'^(M)), then the sequence ISIn(to) for every to £W 
is dense in the interval 

s = -^{[o,i]) = n{[o,i]), (18) 

where ^{t) = $(t) — t is a displacement function of ^ and Q(t) := T~^{t + g) — T~^{t). 

2) If if is not transitive, then the sequence ISIn{tQ) for tQ £ A (the total lift of A to M) is dense 
in the set 

S = ^{A) = n{Ao), 

where Aq is a lift to [0, 1] of a subset A C A, such that the semi-conjugacy 7 is invertible on 
A, and fi := r~"^(t + g) — T~^{t), where T ■.= T \ Aq is a lift of ^ cut to the set Aq. 
Moreover, when one takes tg G K\ A, then for every t G A there exists an increasing sequence 
Uk, A: G N, such that for every I G'N we have 

lim /5/;($"H*o)) = $''^+'(to) - ^""^^^'Hto) = $'(t) - ^^-\t) = ISIiit) 

Since usually we do not know the formula for the (semi-)conjugacy T (except for the Perfect 
Integrator), the equivalent formula for the concentration set of ISI involving 0, is not directly 
useful but it is used in proving statements concerning the distribution of interspike-intervals with 
respect to the unique invariant measure. 

Proof of Proposition 3.10. The above proposition is a direct consequence of Proposition 3.1 
in [Marzantowicz, Signerska 2012], the corresponding statement for the displacement sequence 
of an orientation preserving circle homeomorphism with irrational rotation number. D 

Proposition 3.10 means that even if we are not able to compute directly the set of concen- 
tration of interspike-intervals, we know at least that interspike-intervals practically fill a whole 
interval (i.e. do not form for instance something in the type of a Cantor set), if only / is smooth 
enough. This is also visible in numerical Example 5. However, note that in a special case, where 
{/? is a strict rotation (as happens for example for LIF and PI with constant input), this interval 
degenerates to a single point {g} (since the rotation is an isometry). 

We will discuss the distribution /iisi of interspike-intervals with respect to the unique (up to 
normalization), 99-invariant measure //. 
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Definition 3.11 Suppose that the rotation number g{^) is irrational. Let ^ be the unique in- 
variant probability measure for y? ~ $ mod 1. The distribution of interspike-intervals is defined 
as 

fiisiiA) := fi{{t G [0, 1] : $(t) -t€A}) = /i(^-i(^)), AcR 

where ^{t) = ^{t) — t, t £ [0, 1], is a displacement function associated with $. 

Note that since <l> mod 1 is periodic with period 1, we consider only t G [0,1]. Moreover, 
although the measure fi has support contained in [0,1], as it is the invariant measure for <& 
mod 1 : [0, 1] — >• [0, 1], the measure /iisi has support equal to ^{[0, 1]), which in general might 
not be contained in [0, 1] but it is always contained is some interval of length not greater than 
1 because $ maps intervals of length 1 onto intervals of length 1 due to the fact that $(t + 
1) = ^{t) + 1 for every t (the resulting interval, containing supp{fiisi), is shifted by a from its 
projection mod 1 into [0, 1], where a > is such that $(0) = a). We can consider fj,qi{A), where 
A is an arbitrary subset of M, if we adopt the convention that /iisi is defined on the whole M but 
it simply vanishes everywhere outside ist support. 
By A denote the Lebesque measure on [0, 1] . 

Proposition 3.12 Under the assumptions of Proposition 3.10 the distribution fijsi is the trans- 
ported Lebesque A measure: 

1. If if is transitive, then 

^iisi{A) = K(n-\A)), AcR 

and the support of fijsi equals 

supp{fijsi) = ^{[o,i]) = n{[o,i]). 

2. If if is not transitive, then analogously 

^,isi{A)=m-\A)), Acs, 

and the support of fijsj equals 

supp{fiisi) = ^(A), 

where Q, Q, A and S are as in Proposition 3.10. 

Obviously, the support supp(/xisi) is just the set of concentration of the interspike-intervals 
sequence. 

Proof of Proposition 3.12. Notice that //jsi corresponds to the distribution /iijr of the dis- 
placement sequence of ip and compare with Proposition 3.3 in [Marzantowicz, Signerska 2012]. 
D 

We are concerned with the distribution /^isi of interspike-intervals with respect to the natural 
invariant measure /x, since this theoretical distribution is a limiting distribution of interspike- 
intervals computed along an arbitrary trajectory: 

Proposition 3.13 Under the assumptions of Proposition 3.10 (regardless the transitivity ofip), 
for A CR we have 

,. nO<i<n-l: ISIi{t)eA} 

hm = fiisi{A), 

n— >oo n 

where ft denotes the number of elements of the set, and the above convergence is uniform (with 
respect to t GR). 

The average interspike interval alSI (which equals the rotation number q{^)) is the mean of 
the distribution ^isi'- 



aISI= / $(t) - t dn{t) = / dfiisi. 

Jr Jr 



Interspike-intervals of integrate-and-fire models 14 

Proof. The statements can be justified by the Birkhoff Ergodic Theorem applied to the observ- 
able ^(i) = $(i) — t. The uniform convergence in the first part follows from the fact that the 
system (<I> mod 1, [0, l],/i) is not only ergodic but uniquely ergodic (compare with Proposition 
4.1.13 and Theorem 11.2.9 in [Katok, Hasselblatt 1995] or Proposition 3.12 in [Marzantowicz, 
Signerska2012]). D 

Our aim will be to consider parameter-dependant IF systems and to formulate results de- 
scribing how the distribution fiisi varies with change of the parameter. 

Definition 3.14 (see e.g. [Bartoszynski 1991]) Let X be a complete separable metric space 
and A4{X) the space of all finite measures defined on the Borel a-field B{X) of subsets of X. 

A sequence /i^ of elements of M {X) is called weakly convergent to fj, £ Ai {X) if for every 
bounded and continuous function f on X 



X . 



lim / Xf{x) dfin{x) = / Xf{x) dfi{a 

n.^oo J J 

We denote the weak convergence as /i„ =^ fi. 

Definition 3.15 A Borel set A is said to be a continuity set for fi if A has fi-null boundary, i.e. 

^i{dA) = 

One can show (cf. [Rao 1962]) that //„ =^ fj, if and only if for each continuity set A of /i, 
lim Hn{A) = ti{A). 

Proposition 3.16 Consider the systems x = —ax-\-f{t) and x = —ax + fn{t), n G N, where the 
functions fn, f ^ -^£;(^) ^'"^ measurable, periodic with period 1 and f satisfies /(t) — o" > ^ > 
a.e.. Suppose that all the induced firing maps $„ and $ have irrational rotation numbers, Qn and 

(n) 

Q, respectively. By fXjgj and fiisi denote the interspike-interval distributions, correspondingly for 
$n and $, with respect to the corresponding invariant measures //^"^ and ji. 
If fn^ f «n L'^^{M) -topology, then 

(n) ^ 

M/5/ =^ l^ISI- 

Proof. Recall that the invariant measures, ^u'"^ and ^u, are the Lebesque measure transported by 
the maps r„ and T (semi-)conjugating corresponding firing maps <!>.„ and $ with the rotations. 
Since we already know that the mapping / i— t- F is continuous from the Lj^^(]R)-topology into 
C°(M), it must hold that F„ ^ F in C°(M) (with supR-topologies) . But then /i(") => ^, i.e. 
we have the weak convergence of the invariant measures. Since the interspike-interval distribu- 
tions are in turn the invariant measures transported by the corresponding displacement functions 

(n) 

^„ — >• ^ in sup]j, by the same argument we get the statement on ^Ujgj and /^isi. □ 



Recall that the weak convergence of measures does not imply the point-wise convergence of 

in) 

the corresponding densities: in general the densities of /ijgj or ^uisi might not exist, as in Example 
3. 

Notice that in the above proposition we needed the fact that all the rotation numbers Qn and 
Q are irrational since this guarantees that the unique invariant measures ^^^' and /u exist and we 

in) 

can define the distributions /ijgj and /Uisi- Later on we will see what happens if the intermediate 
firing maps $„ may have rational rotation numbers as well. 

However, now we want to formulate some more detailed theorems on convergence of interspike- 
interval distributions. This is quite simply achievable for the simplest model, the Perfect Inte- 
grator Model. 

Proposition 3.17 Consider the systems of Perfect Integrators x = fn{t), ?^ G K, and x = fit), 
where the functions /«,/ G C'^(M) are periodic with period 1, /n(i), f{t) > 0, fn ^ f in C^ 
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and where all the rotation numbers of the firing maps are irrational, Qn, Q G M \ Q. Then the 
invariant measures jv-'^' and fi have densities, say g^ and g correspondingly, and 

gn^g mC\[0,l]). 

As for the distributions of interspike intervals, if additionally the set of critical points of the 
displacement function ^ of the limiting firing map $, i.e. the set Cq/ := {t € [0, 1] : ^'{t) = 
-^=^ ^'{t) = 1}; is of Lebesque measure 0, then we have 

sup[|/ig|(I) - M/5/(/)|, lej]^0, (19) 

where J denotes the class of all intervals I C [0, 1] (open, closed, half-closed). 

Proof. Proposition 3.4 provides the following formula for the unique invariant probability mea- 
sure ^ of the firing phase map for the Perfect Integrator: 

^(A) = r )^ \ ^ , ^ C [0, 1] - Borel subset. (20) 

J[o,i] /(^) ^■^ 

This formula is also consistent with the formula for the (semi-)conjugacy T, since by the standard 
result on circle homeomorphisms (see [de Melo, van Strien 1993], p. 34) it holds that T(t) = 
/.i([0, i]) (provided that r(0) = which we can assume without the loss of generality as the 
conjugacy T is given up to the additive constant). Thus gn{t) = /«(*)/ /g fn{u) du = V^{t), 
t G [0,1], correspondingly g{t) = fit)/ L f{u) du = T'{t), and the uniform convergence of 
densities follows. This in particular implies that 

sup[|/i(")(A) - i2{A)\; A - Borel subset of [0, 1]] -^ 0. (21) 

Indeed, by the existence and convergence of densities T'^ and V, \fi^'^\A) — fi{A)\ = \ f^ r^(M) — 
r'(ii) du\ < £A{A) for sufficiently large n, but since A{A) < 1, the convergence is uniform with 
respect to the choice of A C [0, 1]. 

Unfortunately, without the assumption on the 0-measure of the set of critical points of the lim- 
iting displacement function ^, we cannot assure that the distribution /iisi of interspike-intervals 
has density (with respect to the Lebesque measure), as we will see in Example 3. However, under 
this assumption by Proposition 3.7 in [Marzantowicz, Signerska 2012] we obtain (19), i.e. we 
know that convergence of interspike-intervals distributions is uniform on the collection of all the 
intervals (in this case the density of /xigi exists by Theorem 3.18 below, but the densities of //Jgj 
might still not exist and we cannot argue as above for (21)). D 

In order to compute the set Cf for Perfect Integrator one has to solve in t the implicit 
equation /(i) = /(<I>(t)) by (14), which usually is difficult. But in the forthcoming examples 
we will see that verifying the assumption on the zero Lebesque measure of this set is sometimes 
not that challenging. We remark only that when in particular / is constant, this assumption is 
not satisfied but in this case the emerging firing map <I> is exactly the lift of the rotation by g 
and the distribution of interspike intervals equals simply the Dirac delta 5g and thus yUjsi is not 
absolutely continuous with respect to A. 

The theorem below provides sufficient conditions for the distribution /zisi to have the density 
with respect to the Lebesque measure. We formulate it in the most general form: 

Theorem 3.18 Suppose that the firing map <I> arising from the system x = F{t,x) is a C^- 
diffeomorphism with irrational rotation number g, which is conjugated with the translation by 
g via a C^ -diffeomorphism T and that the set Cji C [0, 1] of critical points of the displacement 
function ^ Lg i] is of Lebesque measure 0. 

Then the distribution fijsi is absolutely continuous with respect to the Lebesque measure A 
with the density A(y) equal to 

A() = l^ ^/y 0supp(/x/5/); 
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where the latter is well-defined almost everywhere in supp(/i/5'/), i.e. in supp{fj,jsi) \ V{C\i,), 
where V{C^,) denotes the set of critical values of ^ \ [0,1]. 

Proof. The theorem is a mere tautology of Theorem 3.10 in [Marzantowicz, Signerska 2012]. D 

In particular for the Perfect Integrator we make use of the formulas (14) and (15) for the 
derivative $'(t) and the conjugacy F in order to obtain that (22) reduces to: 



if y [min„g[o,i) $(u) - u, max„g[o,i) $( 



u -u: 



^^'' [ EtG*-iCy) f/flu)du\m'^fm)) \ '^y^ [min„g[o,i) Hu) - u,max„6[o,i) $(n) - u]. 

Example 3. Consider the systems x = fn{t), where 

/„(t) = An + Bn cos(27rnt) 

and 

An^ Ao > and < B^ -^ 0. 

Suppose that the constants An and Bn are such that fn{t) > 0, at least for sufficiently large 
n G N. In particular, we have the convergence fn — ?• /o in C"^(M), where /o = Aq. The firing 
maps ^n are then the lifts of circle diffeomorphisms with rotation numbers ^n = ~- Moreover, 
on the account of Proposition 2.9, $„ — ^ ^o in C'^(M), where ^^{t) = t + Qo = i + — '^s the firing 
map induced by the equation x = /o(i) and simply a lift of the rotation by qq. The firing maps 
<!>„ and <I>o are conjugated to the corresponding rotations, respectively, via diffeomorphisms 



rt jD 

r„(t) = Qn fn{u) du = t+ - — ^ sin(27rnt) 



and 

ro(t) = t 

Assume that Qn, Qo ^ "^XQ, 71 £ 'N. Obviously, r„ — )• Fq in C^(M). In particular, the densities 
^ni^) ~ "^^ ^^'^ ^[((t) = ^^^^ of invariant measures fj,^"^^ and fj,^'^' converge uniformly. As for 

the interspike-interval distributions, we certainly have ^|gj =^ Misi- However, the assumption 
on the zero measure set C^^ is not satisfied since <I>o is a lift of the rotation and its displacement 
^0 = ^0 is a constant function. Thus the set of critical points of ^q has full measure and indeed 
the distribution /ujgj is degenerated to a point ^o (i-^- it is not absolutely continuous with respect 
to the Lebesque measure). Nevertheless, the distributions /i|gj are absolutely continuous since 
the sets C^„ of critical points of displacement functions ^n are countable (and the densities 
A^"^(y) exist on the ground of Theorem 3.18). Indeed: Note that i G M is a critical point of 
^„ if and only if ^n{t) = 1. But <I>^(t) = fj{l^%)) = 1 means that cos(27rnt) = cos(27rn$n(i)) 
which holds if and only if sin(7rn($„(t) + t)) =0 or sin(7rri(<^„(t) — t)) = as follows from 
the formula cos(a) — cos(/3) = — 2sin(^^2^) sin(^^^). Further, sin(7rn(<I>„(t) — t)) =0 only for 
^n{t) — t = n, where A; G N, thus only for countably many choices of values Vk = — oi the 
displacement $n(^) — t- Now we will show that for every n G N each value v of the displacement 
function ^n(i) = ^nit) — i can be attained for at most countably many arguments t G M: Fix 
u G M. If i; = <I>(t) — t for some t G M, we might assume that v G (0, 1) (values of the displacement 
function are always contained is some interval of length not greater than 1, moreover ti = or 
V = 1 for some t would imply that the firing phase map c^„ has a fixed point at x = e^'^** which 
contradicts the irrationality of the rotation number Qn). From definition of the firing map we 
have 

1 = An{^n{t) - + ^ sin(27r7i$„(t)) - ^ sin(27rnt) 

= AnV -\ sin(27rn(t' + t)) sin(27rnt) 

27rn 27rn 
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This equality, after some calculations, leads to 

7rn(l — Anv) 



Bn 



sin(7rnt)) cos(7rn(2t + v)). 



For V S (0, 1) the above equation is equivalent to 

Dn,v = cos(t), 

where D^^v = b(-~( " 1') ^'^'^ ^ ~ '7rn(2t + t;). For fixed n and v Dn,v is constant and this equality 
can be satisfied for at most countably many t G M and thus for every n G N and t> G M also the 
entire equation v = ^n{t) — t is satisfied for at most countably many t G M. Now, since there 
are only countably many choices of values Vk = ^nit) — t such that sin(7rn(<I>„(t) — t)) = and 
each value Vk is attained for at most countably many arguments i G M, sin(7rn(<^„(i) — t)) =0 
for at most countably many i G M. Even easier one can justify that sin(7rn($„(t) +t)) =0 for at 
most countably many t G M, since $„,(i) +t is strictly increasing and thus it attains each value v 
exactly once. Thus for each n G N the displacement functions ^n have countably many critical 
points. Theorem 3.18 yields now that the distributions /i|gj have densities A^"^ with respect to 
the Lebesque measure. Nevertheless, the limiting (in terms of weak convergence of measures) 
distribution ^Jgj does not have the density. 

Example 4. Let us consider Perfect-Integrator Model: x = fn{t), where 

/„(t) = A + B cos(27rnt), n G N. 

If ^ > S > then fn{t) > for every n G N and t G M. In this case the firing maps $„ : M — )■ M 
induced by the equations x = /«(t) are lifts of orientation preserving circle homeomorphisms 
ipn '■ S^ ^ S^ . Moreover, each $„ is conjugated with the lift Rg^{t) = t + -^ of the rotation by 
Qn = 1/ Jq A + B cos{2irnt)dt = ^ via 

fnA + B cos(27rnu)du B 

In particular, all the rotation numbers Qn of $„ are the same and can be set rational or irrational 
with arbitrary diophantine properties (it depends only on the choice of A) . 

Since r„ — )• Id uniformly (i.e. in C''(M)), also F"^ — )■ Id uniformly. Consequently, 

^ , , ^ 1 ,^ , , , ^ 1 / i?sin(27rni) 1 , 1 

$„(t) = F-i(F„(t) + Qn) = r-Ht + ^^^^ ' + -) ^ t + - 

and thus also <!>„ — >■ <^o uniformly with ^^{t) = t + ^ being simply a lift of the rotation by ^. 
Note that $o(0 can be seen as a firing map induced by the equation x = fo{t) with fo{t) = A. 
However, it is not true that /„ — t- /q uniformly or even pointwise since for example for t = ^ the 
sequence fn{t) = A + B cos{2Tmt) does not converge at all. 

From the uniform convergence <!>„ — )• $o we have the weak convergence fin =^ fJ-o of the 
corresponding unique invariant probability measures: 

, ^ A/ fn(u)du 

/in(^) = ^^'^^ , yc[o,i] 

where ^q = ^ is the Lebesque measure on [0, 1] (being the invariant measure of $o)- From the 
formula for /i„ we see that the invariant measures fin have densities 

T i^i 

and the measure fiQ has a density 

/o - ^ = 1 



Interspike-intervals of integrate-and-fire models 18 

However, fn ^^ foi similarly as fn ^^ fo- In particular, this shows that the weak convergence of 
measures does not imply (even pointwise) convergence of the corresponding continuous density 
functions. Thus the sequence of conjugacies r„ does not converge in C"^(M) but only in C'^(M). 

3.3 Empirical approximation of the interspike-interval distribution yUisi 

Virtually we are able to calculate only the empirical interspike-interval distribution, i.e. the 
distribution derived by counting interspike-intervals along a particular trajectory (a run of a 
system). In case of the rational firing rate necessarily there are periodic orbits (and usually also 
non-periodic but these are attracted to the periodic ones) and although all the periodic orbits 
have the same period, the (finite) sequences 181^(^0 ) derived along the orbit of each periodic 
point to might consist of different elements unless the system induces a rigid rotation. However, 
in case of the irrational rotation number we have the unique invariant ergodic measure that gives 
the distribution of orbits phases. Thus yUjsi is also well-defined and the empirical distribution 
of interspike-intervals derived for any trajectory will well approximate /-iisi, provided that the 
trajectory is long enough. However, basically when we do numerical computations, we do not 
work with irrational rotation numbers, but the rational ones which are close to them. We will see 
in what meaning the empirically derived interspike-interval distribution for an arbitrarily chosen 
initial condition (f , 0) of a system with rational firing rate, being "close" enough to our entire 
system with irrational firing rate, approximates the desired distribution /iisi of the "irrational" 
(ergodic) system. 

We have to define the empirical interspike-interval distribution formally: 

Definition 3.19 Let $ be the firing map arising from the IF system x = F{t,x). Choose the 
initial condition (t,0) (xr = 0). Then the empirical interspike-interval distribution for the run 
of length n (i.e. having n-spikes) starting at (t, 0) equals 



^ n—l 
n ^ — ' 



, ^ ISIAt)-, 
j=0 



where ^isiAt) is a Dirac delta centered at the point ISIi{t) = (^^'^ {t) — $*(t). 

Thus 0Jn,t{A) = iftiO <i<n-l: ¥+^{t) - ¥{t) £A], A<Z M. 

Note that if (p with rotation number ^is close in C^(5'^)-metric to ip with irrational rotation 
number q, then the rotation numbers q and q are also close due to the continuity of the rotation 
number in C'^(5'^). 

In order to measure the distance between interspike-interval distribution we introduce the 
notion of the Fortet-Mourier metric: 

Definition 3.20 Let fi and v be the two Borel probability measures on a measurable space (0, J^), 
where Q. is a compact metric space. Then the distance between the measures (i and v is defined 
as 

dpifJ-ji^) '■= sup{| / Qf dfi — Qf dv\ : f is 1-Lipschitz\ . 

Using Theorem 3.15 in [Marzantowicz, Signerska 2012] we formulate the following: 

Proposition 3.21 Consider the integrate-and-fire systems x = —ax -\- fei{t) o-'nd x = —ax + 
fe2it)j where fg. G L^^(R), periodic with period 1 and foiit) — o" > <;^ > 0. By ^g^ and ^g^ denote 
the firing maps emerging from the corresponding systems. Suppose that the rotation number 
associated with ^g^ is irrational. 

For any e > there exists a neighbourhood U of fg^ in Lf^^{M.) -topology such that if fg^ G U, 
then for every initial condition (t, 0) we have: 

d^(lima;iy,Mij;)<e, (23) 



>oo 
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where io^^l is the empirical inter spike-interval distribution for the run of the system x = —ax + 

fe2{t) starting from (t, 0) and /ij^j is the interspike-interval distribution for x = —ax + fe^it) 
with respect to its invariant measure /i*- ' . 

Proof. The proof relies again of the fact that the mapping / i— )• <I> is continuous from ess sup- 
topology into C'^(M). Then the statement follows immediately from Theorem 3.15 in [Marzan- 
towicz, Signerska 2012]. D 

As the convergence under Fortet-Mourier metric implies weak convergence of measures ([Gibbs, 
Su 2002]) we conclude: 

Corollary 3.22 Under the notation as in Proposition 3.21, for every t ^'K we have 

The above result can be illustrated by the numerical example: 

Example 5. We investigate the system x = —x + 2(1 + /3cos(27rt)) (the computations were 
done in Matlab). Notice that the analogous example was considered in a classical paper [Keener, 
Hoppensteadt, Rinzel 1981], but the authors gave no explanation of the behaviour of interspike- 
intervals histograms under a small change of a parameter. Our results allow us to make theoretical 
predicates of what actually we can expect for the interspike-interval distribution when the pa- 
rameter /3 varies. We easily obtain that for < /3 < 0.5 the firing map <& : M — t- M is a lift of 
a circle homeomorphism. The results of numerical simulations for /3 = 0,0.1,0.15,0.2 and 0.25 
are presented in Figure 2. All the simulations were started from the initial condition (0,0). 

When /3 = the system is forced by the constant input which induces the rotation by 
an irrational angle. Indeed, by solving the equation and direct computation we obtain that 
ISI„(t) = Q = ln(0.5) ~ 0.6931 for every n and t G M. This is reflected in Figure 2a: the 
firing phases are distributed uniformly in [0, 1] and the iterspike-interval distribution is simply 
a Dirac delta at ISF^ ~ 0.6931. Thus for /3 = we are dealing with the irrational rotation. 
When we slightly change the parameter /3 (Figure 2b-2c, we observe that both the distribution 
of phases and of interspike-intervals change continuously as we anticipate from the fact that 
the corresponding distributions are close in dp metric, since the firing maps are close in C'^(M) 
metric. In particular the distribution of interspike-intervals is concentrated in the interval around 
the value of ISF^ and the distribution practically fills this whole interval, which is consistent 
with Proposition 3.10 as in our case the input function is smooth. 

We also have checked what happens for greater values of /3 and the results are presented in 
Figure 3. When /3 = 0.4, both firing phases and interspike-intervals admit ten distinct values, 
which suggest that there is a periodic orbit of period 10 and indeed, the rotation number was 
computed as ^ = 7/10. When the parameter changes to /3 = 0.45 it seems that there are no 
more periodic orbits (and the rotation number is irrational). Thus here the small change of the 
parameter by 0.05 causes the real qualitative change in the behavior of the system. However, we 
must recall that usually (i.e. unless the firing phase map is conjugated to the rational rotation), 
having the rational rotation number of a particular value p/q is stable with respect to the small 
change of parameters and thus the system (in terms of periodic orbits) behaves in the same way, 
which is what we call phase locking. In fact the smaller the denominator of the rotation number, 
the more stable it is. Thus the small change of parameters within the neighborhood of the firing 
map with rational rotation number, also does not cause a qualitative change of the behaviour 
of the system, as long as this change of parameters preserves the rotation number (recall that, 
under some constraints, the mapping <I> i— t- ^ is a Devil-staircase, strictly increasing at irrational 
values and constant at rational ones with the longest intervals of being constant occurring at 
Farey fractions^ cf. e.g. Proposition 11.1.11 in [Katok, Hasselblatt 1995]). 

In Figure 3 we may see also what happens for values of /3 greater than 0.5, precisely for /? = 1 
and (3 = 2. However, for these parameter values the firing map is not a homeomorphism any 
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(a) Firing phases (left) and interspike-interval 
(right) distribution for /3 = 0. 



(b) Firing phases (left) and interspike-interval 
(right) distribution for /? = 0.1. 





(c) Firing phases (left) and interspike-interval 
(right) distribution for f3 = 0.15. 



(d) Firing phases (left) and interspike-interval 
(right) distribution for f3 = 0.2. 







(e) Firing phases (left) and interspike-interval 
(right) distribution for /3 = 0.25. 

Figure 2: Distribution of firing phases and interspike-intervals for the model x 
13 cos(27rt)) and /3 = 0, 0.1, 0.15, 0.2, 0.25. 



-ax + 2{l + 



more and thus in particular the results might depend on the initial condition (t,0). Therefore 
these cases are beyond the scope of this work. 

Remark 3.23 Note that the analogous statements of Propositions 3.13, 3.16 and 3.21 hold for 
the distribution of the firing phases, which is simply the invariant measure fi. 



4 Discussion 

We have shown many specific properties of the interspike-interval sequence arising from linear 
periodically driven integrate-and-fire models for which the emerging firing phase map is a circle 
homeomorphism. Many of them hold also for the general class x = F{t, x) of integrate-and- 
fire models (thus also non-linear models), as we prove in forthcoming paper "Firing map and 
interspike-intervals for the general class of integrate-and-fire models with periodic drive". 

However, it would be interesting to have such rigorous results on interspike-intervals for 
periodically driven integrate-and-fire models with the firing phase map being not necessary a 
homeomorphism, but for instance just a continuous circle map. We predict that in such systems 
greater variety of phenomena may be observed, mainly due to the fact that in this case we have 
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(a) Firing phases (left) and interspike-interval 
(right) distribution for /3 = 0.4. 




(b) Firing phases (left) and interspike-interval 
(right) distribution for /3 = 0.45. 



(c) Firing phases (left) and interspike-interval 
(right) distribution for (3=1. 



(d) Firing phases (left) and interspike-interval 
(right) distribution for (3 = 2. 



Figure 3: Distribution of firing phases and interspike-intervals for the model x = —ax + 2{l + 
(3 cos(27ri)) and (3 = 0.4, 0.45, 1, 2. 

rotation intervals instead of the unique rotation number. 

The natural extension of this research is detailed description of the interspike-interval se- 
quence for IF systems with an almost periodic input ([Marzantowicz, Signerska 2011]) and for 
bidimensional IF models ([Touboul, Brette 2009]). 
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